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Abstract. If y is a representation of a linear algebraic group G, a set S of 
G-invariant regular functions on V is called separating if the following holds: 
// two elements v,v' aV can be separated by an invariant function, then there 
is an f a S such that f{v) ^ /(f')- It is known that there always exist finite 
separating sets. Moreover, if the group G is finite, then the invariant functions 
of degree < \G\ form a separating set. We show that for a non-finite linear 
algebraic group G such an upper bound for the degrees of a separating set 
does not exist. 

If G is finite, we define /9scp(G) to be the minimal number d such that for 
every G-module V there is a separating set of degree < d. We show that for 
a subgroup H G G vfe have /3aep{H) < /3sep(G) < [G : H] ■ /3aep(^^), and that 
/3scp(G) < /3scp(G/-ff) ■ 0BepiH) in case H is normal. Moreover, we calculate 
/3scp(G) for some specific finite groups. 



1. Introduction 

Let K be an algebraically closed field of arbitrary characteristic. Let G be a linear 
algebraic group and X a G-varicty. i.e. an affinc variety equipped with a (regular) 
action of G, everything defined over K. We denote by 0(X) the coordinate ring 
of X and by 0{X)^ the subring of G-invariant regular functions. The following 
definition is due to Derksen and Kemper [DK02, Definition 2.3.8]. 

Definition 1. Let X be a G-varicty. A subset S C 0{X)^ of the invariant ring of 
X is called separating (or G-separating) if the following holds: 

For any pair x,x' G X, if f{x) ^ f{x') for some f G 0{X)'~^ then there is an 
h S such that h{x) ^ h{x'). 

It is known and easy to see that there always exists a finite separating set (see 
[DK02, Theorem 2.3.15]). 

If 1^ is a G-module^ i.e. a finite dimensional vector space with a regular linear 
action of G, we would like to know a priory bounds for the degrees of the elements 
in a separating set. We denote by 0{V)d C 0{V) the homogeneous functions of 
degree d (and the zero function), and put 0{V)<d ■= ®i=o 

Definition 2. For a G-modulc V define 

/3sop(G, V) := mm{d \ 0{V)<d is G-separating} e N, 

and set 

/3sop(G) := sup{/^scp(G, V)\V a. G-module} e N U {oo}. 
The main results of this note are the following. 
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Theorem A. The group G is finite if and only if /?scp(G) is finite. 

In order to prove this we will show that Pscp{K^) ~ oo, that Pscp{K*) — oo, 
that /3scp(G) = cxD for every semisimple group G, and that /3scp(G°) < /3sop(G) (see 
section 3, Theorem 1). 

Theorem B. Let G be a finite group and H d G a subgroup. Then 

PsepiH) < Aep(G) <[G:H] f3s,piH), and so Aep(G) < |G|. 
Moreover, if H <Z G is normal, then 

Acp(G) </3,ep(G/i?)/3,ep(i/). 

This will be done in section 4 where we formulate and prove a more precise 
statement (Theorem 2). 

Finally, we have the following explicit results for finite groups. 

Theorem C. (a) Let charX = 2. Then P^cpiS^) = 4. 

(b) Let char A' = p > and let G be a finite p-group. Then /3scp(G) ~ \G\. 

(c) Let G be a finite cyclic group. Then /3scp{G) = \G\. 

(d) Assume char(A") ~ p is odd, and r > 1. Then /3scp (-D2p'- ) — 2p^ . 

For a reductive group G one knows that the condition f{x) ^ fix') for some 
invariant / (in Definition 1) is equivalent to the condition GxCiGx' = 0, see [New78, 
Corollary 3.5.2]. This gives rise to the following definition. 

Definition 3. Let X be a G- variety. A G- invariant morphism (p: X ^ Y where Y 
is an affine variety is called separating (or G -separating) if the following condition 
holds: For any pair x,x' £ X such that Gx H Gx' = % we have ip{x) ^ fix'). 

Remark 1 . li (p: X ^ Y is G-separating and A' C A a closed G-stable subvariety, 
then the induced morphism flx' : A' ^ y is also G-separating. 

Remark 2. Choose a closed embedding Y C A™ and denote by i^Ji, . . . , (pm & C>{X) 
the coordinate functions of (ys: X Y C A™. If ip is separating, then {ipi, . . . , ipm} 
is a separating set. The converse holds if G is reductive, but not in general, as 

shown by the standard representation — > GL2(A') given by s M- , which 



does not admit a separating morphism. 
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2. Some useful results 

We want to recall some facts about the /3sop-values, and compare with the results 
for the classical /3- values for generating invariants introduced by SCHMID [Sch91]: 
/3(G) is the minimal d G N such that, for every G-module V , the invariant ring 
0{V)'-^ is generated by the invariants of degree < d. 

By Derksen and Kemper [DK02, CoroUary 3.9.14], we have ;3acp(G) < |G|. 
This is in perfect analogy to the Noether bound, which says /3(G) < |G| in the 
non-modular case, see [Sch91, FleOO, FogOl]. Of course we have /3sep(G) < /3(G), 
so when good upper bounds for /3(G) are known, then we have an upper bound for 

/3sep(G). 

In characteristic zero and in the non-modular case there are the bounds by 
SCHMlD [Sch91] and by Domokos, Hegedus, and Sezer [DHOO, Sez02] which 
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improve the Noetlier bound. In particular, [Sez02] shows for non-modular non-cyclic 
groups G that /3(G) < ||G|. 

For a hnear algebraic group G it is shown by Bryant, Derksen and Kemper 
[BK05, DK04] that /3(G) < oo if and only if G is finite and p \ \G\ which is the 
analogon to our Theorem A. For further results on degree bounds, we recommend 
the overview article of Wehlau [Weh06]. 

The following results will be useful in the sequel. 

Proposition 1. Let H <Z G be a closed subgroup, X an ajfine G-variety and Z an 
ajfine H -variety. Let l: Z ^ X be an H-equivariant morphism and assume that l* 
induces a surjection 0{X)'^ -» 0{Z)^ . If S <Z 0{X)^ is G-separating, then the 
image l*{S) C 0{Z)^ is H -separating. 

Proof. Let / £ 0{Z)^ and zi,Z2 G Z such that /(zi) f{z2)- By assumption / = 
t*{f) for some / G 0{X)^ . Put := l{z,). Then />i) = f{zi) /(zj) = /(a^2). 
Thus we can find an h G S such that h{xi) ^ h{x2). It follows that h := i*{h) G 
L*[S) and h{zi) = h{xi) ^ h{x2) = h{z2)- □ 

Remark 3. In general, the inverse map (t*)^^ does not take i?-separating sets to 
G-separating sets. Take C SL2 as the subgroup of upper triangular unipotent 
matrices, X = K'^®K'^@K'^ the sum of three copies of the standard representation 
of SL2 and Z ~ (B the sum of two copies of the standard representation 
of K'^ . Then l: Z ^ X . {v,w) ^ ((l,0),?;,w) is i^T^-equivariant and induces 
an isomorphism 0{X)^^'^ ^ 0{Zy^^ (Roberts [Rob61]). In fact, choosing the 
coordinates {xQ,xi,yo,yi, zq, zi) on X and (yo? zq, zi) on we get from the 
classical description [dCP76] of the invariants and covariants of copies of K^: 

Q(^j^-^Sh2{K) ^ K[yiXo - yoXi,ziXo - ZoXi,yiZo - yo^i], 
0{Y)^^ = K[yi,Zi,yiZo - yQZi], 

and the claim follows, because l*{xo) = 1, i*{xi) = 0. 

Now take S := {yi, zi,yi{yiZo - j/o 21), 21(2/1^0 - yo^i)} C 0{Z)^^ . We show 
that 5" is a iir+-separating set, but {l*)~^{S) C 0{X)^^^ is not SL2-separating. For 
the first claim one has to use that if yi and zi both vanish, then the third generator 
yi^o ~ UoZi of the invariant ring 0{Y)^ also vanishes. For the second claim we 
consider the elements 1; = ((0, 0), (0, 0), (0, 0)) and v' = ((0, 0), (1, 0), (0, 1)) of X, 
which are separated by the invariants, but not by (l*)~^{S). 

For the following application recall that for a closed subgroup H C G of finite 
index the induced module Ind^ V of an i/-module ^ is a finite dimensional G- 
module. 

Corollary 1. Let H G G be a closed subgroup of finite index and let V be an 
H-module. Then (5scpiH,V) < /3scp(G, Ind^ y). In particular, Pscp{H) < /3sGp(G). 

Proof. By definition, Ind^ V contains V as an i/-submodule in a canonical way. If 
n := [G : H] and G = Ufci ffi^j then Ind§ V = 0"^i giV. Moreover, the inclusion 
L -.V Indgy induces a surjection l* : 0{lnd%{V))^ OiV)" , f ^ In 
fact, for / G 0{V)^, apreimage / is given by /(ffiwi, . . . ,.gnfn) := '"t ^ 

V, which is easily seen to be G-invariant. Now the claim follows from Proposition 1 
above, because the restriction map l* is linear and so preserves degrees. □ 
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Proposition 2 (Derksen and Kemper [DK02, Theorem 2.3.16]). Let G he a 
reductive group, V a G-module und U G V a submodule. The restriction map 
0{V) — ^ 0{U), f I— > f\u takes every separating set ofO{V)'~^ to a separating set of 
0{U)'^ . In particular, we have 

Aep(G,(7) </3,ep(G, V). 

Let us mention here that in positive characteristic the restriction map is in 
general not surjective when restriced to the invariants, and so a generating set is 
not necessarily mapped onto a generating set. 

We finally remark that for finite groups there is a G-module V such /?sop (G, V) = 
/3scp(G). The same holds for the /3- values in characteristic zero. 

Proposition 3. Let G be a finite group group and V^cg ~ KG its regular represen- 
tation. Then 

/3scp(G) ~ /3scp(G, l^'og). 

In fact, every G-module V can be embedded as a submodule in 1/^™^. Since, by 
[DKW08, CoroUary 3.7], PsepiG, F™) = /3scp(G, V) for any G-module V and every 
positive integer m, the claim follows from Proposition 2. 



3. The case of non-finite algebraic groups 

In this section we prove the following theorem which is equivalent to Theorem A 
from the first section. 

Theorem 1. For any non- finite linear algebraic group G we have /3sGp(G) = oo. 

Wc start with the additive group A'+. Denote hy V ~ Kcq © Kei ~ the 
standard 2-dimensional "'"-module: s • eo := eo, s • ei := seg -1- ei for s G /\ + . If 
charier = p > we can "twist" the module V with the Frobenius map i^" : 
, s M> s^ to obtain another A'+-module which we denote by Vpn. 

Proposition 4. Let char iiT = p > and consider the -module W :~ V (B Vp^. 
We write 0(W) = K[xo,xi,yo,yi]. Then 0{W)''^ = K[xi,yi,x{ yi - x{ yo\. In 
particular, PsepiK'^ , W) = p" -|- 1 and so /3scp{K^) — oo. 

Proof. It is easy to see that / := Xq yi — x^ yo is if "'"-invariant. Define the K~^- 
invariant morphism 

t:: W ^ K^, w ^ (oq, ai, &o, &i) (ai,&i,ag bi - a{ bo). 

Over the affine open set U := {(ci,C2,C3) S \ ci ^ 0}, the induced map 
Tr~^{U) — >■ /7 is a trivial /i' "'"-bundle. In fact, the morphism p: U ^ Tr~^{U) given 
by (ci,C2,C3) (0,ci,— c^^ C3,C2) is a section of tt, inducing a i^"'"-equi variant 
isomorphism x U ^ ■k^^{U), (s,w) i~> s ■ p{u). This implies that 0{W)^^ = 
K[xi,x^^,yi,f], hence 0{W)^^ = K[xo, xi,yo,yi] n K[xi,x^'^ ,yi, f], and the 
claim follows easily. □ 

If K has characteristic zero, we need a different argument. Denote by Vn :— S^''V 
the nth symmetric power of the standard "'"-module V = Keo © Kei (see above). 
This module is cyclic of dimension n+ I, i.e. Vn = {K~^Vn) where u„ := e", and for 
any s € , s ^ 0, the endomorphism v t-^ sv — v of Vn is nilpotent of rank n. In 
particular, V^ = Kvq where vq :— eg G Vn. 
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Remark 4. For q > 1 consider the qth symmetric power S'^Vn of the module Vn- 
Then the cychc submodule {K^v"^^) C SWu generated by is ii'+-isomorphic to 
Vqm and {K~^v1)^ = Kvq. One way to see this is by remarking that the modules 
Vn are SL2(-ftr)-modules in a natural way, and then to use representation theory of 
SL2{K). 

Proposition 5. Let char A' = 0. Consider the -module W = V* (B Vn and the 
two vectors w := {xo,vo) and w' := (xo,0) ofW. Then there is a -invariant 
function f G 0{W)^^ separating w and w' , and any such f has degree deg/ > 
n + 1. In particular, f3scp{K~^, W) > n + 1, and so PsepiK^) = oo. 

Proof. Let Ui,U2 be two finite dimensional vector spaces. There is a canonical 
isomorphism 

0{UI © C/2)(p,,) A Hom(5«?72,5PC/i) 
where 0{UI © t^2)(p,q) denotes the subspace of those regular functions on Ul © U2 
which are bihomogeneous of degree {p,q). If F = then for any a; G [/j* and 

u € U2 v/G have 

f{x,u) = xP{Fiu'')). 

(Since we are in characteristic we can identify Sp{Ui) with (SpUi)* .) Moreover, if 
Ui, U2 are G-modules, then ^I* is G-equivariant and induces an isomorphism between 
the G-invariant bihomogeneous functions and the G-linear homomorphisms: 

* : 0(f/r © C/2)g,,) A HomG(5«[/2, ^^C/i). 

For the A'+-module W ~ V* (B Vn we thus obtain an isomorphism 

0{V*(BVn)fpl^ ^RomK+{S'^Vn,SPV). 

Putting p ^ n and q = 1 and defining / G 0{V* © by *(/) = Idy,^, we get 

f{w) = f{xo,vo) = x^^ivo) = x^(e[J) ^ 0, and f{w') = /(a;o,0) = 0. Hence w and 
w' can be separated by invariants. 

Now let / be a iiT^-invariant separating w and w' where deg f — d. We can 
clearly assume that / is bihomogeneous, say of degree {p, q) where p + q ~ d. 
Because / must depend on Vn, we have q> 1. Hence f{w') = f{xo, 0) = 0, and so 
f{w) = f{xo,vo) ^ 0. This implies for F *(/) that F{v^) ^ 0. Now it follows 
from Remark 4 above that F induces an injective map of (A'+uJ^) into S^V, and so 

p+l = dim S^V > dim(A'+w9) ^ qn + l>n+l. 
Hence deg f = p + q > n + 1. □ 

To handle the general case we use the following construction. Let G be an alge- 
braic group and H C G a closed subgroup. We assume that H is reductive. For an 
affine i7-variety X we define 

Gx" X -.^{Gx X)//H Spec(C'(G x X)") 

where H acts (freely) on the product G x X by h{g,x) :— {gh~^ ,hx), commuting 
with the action of G by left multiplication on the first factor. We denote by [g, x] 
the image of {g,x) G G x X in the quotient G x^ X. 

The following is well-known. It follows from general results from geometric in- 
variant theory, see e.g. [MFK94]. 

(a) The canonical morphism G x^ X G/H, [g,x\ i—> gH, is a fiber bundle 
(in the etale topology) with fiber X. 
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(b) If the action of iJ on X extends to an action of G, then Gx^ X ^ G/HxX 
where G acts diagonahy on G/H x X (i.e. the fiber bundle is trivial). 

(c) The canonical morphism l: X ^ G X given by x i— > [e,x] is an H- 
equi variant closed embedding. 

Lemma 1. If ip: G x^ X Y is G -separating, then the composite morphism 
ip o l: X ^ Y is H -separating. Moreover, if S (Z 0{G x^ X)*^ is a G-separating 
set, then its image L*{S) C 0{X)" is H -separating. 

Proof. For x £ X we have G[e,x] ~ \G,Hx\. Therefore, if Hx n Hx' = 0, then 
G[e, x\ n G[e, x'\ = and so o i{x) = •p{[e, x]) ^ <y5([e, x']) = ip o l{x'). The second 
claim follows from Proposition 1, because 0{Gx"X)^ = 0{G x X)*^^^ = 0{X)" 
and so l* induces an isomorphism 0{G x^ X)'^ ^ 0{X)^ . □ 

Now let be a G-module and X := V\h, the underlying iJ-module. Choose 
a closed G-equivariant embedding G/H Gwq ^ W where is a G-module. 
Then we get the following composition of closed embeddings where the first one is 
i?-equivariant and the remaining are G-equivariant: 

H: V\h G x" V ^ G/H x V ^ W x V. 

The map /x is given by iJ,(v) = {wq,v). It follows from Lemma 1 and Remark 1 that 
for any G-separating morphism p:WxV^Y the composition ip o fj,: V\h — > Y 
is i?-separating. In particular, if G is reductive, then for any G-separating set 
S C 0{W X V) the image fi*{S) C 0{V)" is H-separating. Since deg/i*(/) < deg / 
this implies the following result. 

Proposition 6. Let G be a reductive group, H <Z G a closed reductive subgroup 
and V an H -module. If V' is isomorphic to an H-submodule of a G-module V , 
then 

/3scp(i?,V^') < Aep(G). 

Now we can prove the main result of this section. 

Proof of Theorem 1. By Proposition 1 we can assume that G is connected. 

(a) Let G be semisimple, T C G a maximal torus and B D T a Borel subgroup. 
If A G X{T) is dominant we denote by the Weyl-module of G of highest weight 
A, and by C the highest weight line. Choose a one-parameter subgroup 
p: K* and define fco S Z by p{t)u = t''° ■ u for u € D^. For any n e N put 

Then V/^ is a two-dimensional _R'*-module with weights {~kQ,nko). Hence 0{V//)^ 
is generated by a homogeneous invariant of degree n+1 and so fisc-p{K* : V//) = n + 1. 
Now Proposition 6 implies 

n+1 = /3scp(A'*,K0 < /3scp(G) 
and the claim follows. In addition, we have also shown that l3scp{K*) = oo. 

(b) If G admits a non-trivial character x : G — ?■ K* then the claim follows because 
/3scp(G) > /3scp(A'*) = oo, as we have seen in (a). 

(c) If the character group of G is trivial, then either G is unipotent or there is 
a surjective homomorphism G — >■ 7? where H is semisimple (use [Spr98, Corollary 
8.1.6 (ii)]). In the first case there is a surjective homomorphism G and the 



DEGREE BOUNDS FOR SEPARATING INVARIANTS 



7 



claim follows from Proposition 4 and Proposition 5. In the second case the claim 
follows from (a). □ 



4. Relative degree bounds 

In this section all groups are finite. We want to prove the following result which 
covers Theorem B from the first section. 

Theorem 2. Let G be a finite group, H <Z G a subgroup, V a G-module and W 
an H -module. Then 

Acp(i?, W) < /3,ep(G, Indg W) and /3,,p(G, V) < [G : H] A,p(iJ, V). 

In particular 

Pscp{H) < /3scp(G) <[G:H] /3scp(i?), and so /3scp(G) < \G\. 
Moreover, if H C G is normal, then 

Aep(G) < Aep(G/i/)/3,ep(-ff). 

Note that the inequalities /3sop(G,F) < [G : H]l3sep{H,V) and /3sep(G) < |G| 
were already proved by Derksen and Kemper ([Kem09, Corollary 24], [DK02, 
Corollary 3.9.14]). 

The proof needs some preparation. Let V, W be finite dimensional vector spaces 
and if: V W a morphism. 

Definition 4. The degree of ip is defined in the following way, generalizing the 
degree of a polynomial function. Choose a basis {wi, . . . , Wm) of W , so that ^p{v) = 
Er=i fj{v)wj for vfzV. Then 

deg LP := max{deg fj\ j = 1, . . . , m}. 

It is easy to see that this is independent of the choice of a basis. 

If F is a G-modulc and (p: V ^ W a. separating morphism, then jiscp{G,V) < 
deg p. Moreover, there is a separating morphism p: V ^ W ior some W such that 
psep{G,V)=degp. 

For any (finite dimensional) vector space W we regard = K'^ as the 

direct sum of dimW copies of the standard iS^-module K"^. In this case we have 
the following result due to Draisma , Kemper and Wehlau [DKW08, Theorem 
3.4]. 

Lemma 2. The polarizations of the elementary symmetric functions form an Sd- 
separating set ofW^. In particular, there is an Sd- separating morphism ipw ■ W'^ — > 
of degree < d. 

Recall that the polarizations of a function / G 0{U) to n copies of U arc defined 
in the following way. Write 

f{tiUi+t2U2^ ht„M„)= ^ tit2---tnfni2...ir,{ui,U2,...,Un) 

it ,12 , . . . ,in 

Then the functions /i^i^ . i^ (ui, M2, . . . , u„) £ 0{U") are called polarizations of f. 
Clearly, deg /iiij...^^ < deg/. Moreover, if [/ is a G-module and / a G-invariant, 
then all fi^i^...i^ are G-invariants with respect to the diagonal action of G on f7". 
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Proof of Theorem 2. The first inequality l3sap{H,W) < /3scp{G,lnd^W) is shown 
in Proposition 1. 

Let y be a G-module, v,w S V, and let iy9 : V W he a.n _ff-separating morphism 
of degree /3sop(-ff, V)- Consider the partition of G into i7-right cosets: G = UiLi 
where d :^ [G : H]. Define the following morphism 

^: V — ^ /v^ 

where <^(w) := {ifi{giv), . . . ,(p{gdv)) and ipw ■ W'^ is the separating mor- 

phism from Lemma 2. 

We claim that Cp is G-separating. In fact, for g ^ G define the permutation 
cr e 5d by Hgig = Hg^(^i), i.e. g^g = h^ga{i) for a suitable hi e H. Then ip{gigv) = 
f{hi9ij(i)v) = f{ga(i)v) and so (p{gv) = a~^(p{v). This shows that (p is G-invariant. 

Assume now that gv ^ w for all g & G. This implies that hgiV ^ w for all ft. G 
and i = 1, . . . d, and so (p{giv) ^ </'(u') for i = 1, . . . , d, because iy9 is i?-separating. 
As a consequence, (fi{v) ^ a(p(w) for all permutations a G 5^, hence <p(w) 
because ■i/'w is tS^-separating, and so is G-separating. 

For the degree we get degi^ < deg'^vv • deg(^ < d ■ degi^s ~ \G : H\ii^ap{H,V). 
This shows that 

/3scp(G,F) < [G:i/]Aep(i/,^). 
If -ff C G is normal we can find an _ff-separating morphism (p: — of degree 
PscpiH, V) such that is a G/iJ-module and ip is G-equivariant. Now choose an 
G/iJ-separating morphism ip: W ^ U oi degree (3scp{G/ H,W). Then the compo- 
sition o ip: V ^ U is G-separating of degree < deg tp ■ deg (p. Thus 

/3scp(G, V) < /3scp (G/iJ, W) Psep{H, V) < Aep(G/iJ) /3sep(i^), 

and the claim follows. □ 



5. Degree bounds for some finite groups 

In principal, Proposition 3 allows to compute /3sep(G) for any finite group G. 
Unfortunately, the invariant ring 0{Vrcg)^ does not behave well in a computa- 
tional sense. We have been able to compute /3sop(G) with Magma [BCP97] and the 
algorithm of [Kcm03] in just one case (computation time about 20 minutes): 

Proposition 7 (Magma and Proposition 3). Let char A' = 2. Then /Jsop(53) = 4. 

Proposition 8. Let char A' ~ p > and let G be a p-group. Then /3scp{G) = \G\. 

Proof. Let us start with a general remark. Let G be an arbitrary finite group, and 
let y be a permutation module of G, i.e. there is a basis {vi, V2, ■ ■ ■ ■, Vn) of V which 
is permuted under G. Then the invariants are linearly spanned by the orbit sums Sm 
of the monomials m — x'^x'^ ' ' ' ^^n" G 0(V) ~ K^[xi, X2, ■ ■ ■ , Xn] which are defined 
in the usual way: 

Sm ^ f 

feGm 

The value of Sm on the fixed point v -.^ vi + V2 + ■ ■ ■ + Vn S V equals |Gm|. Hence, 
Sm{v) = if p divides the index [G : Gm] of the stabihzer Gm of m in G. It follows 
that for a p-group G we have Sm {v) 7^ if and only if m is invariant under G. 
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If, in addition, G acts transitively on the basis (wi, ■ . ^Vn), then an invariant 
monomial m is a power of xia;2 ■ • • a;„, and thus has degree in > dim V. If we apply 
this to the regular representation, the claim follows. □ 

With Corollary 1 we get the next result. 

Corollary 2. Let char/C ~ p > and G be a group of order rp^ with {r,p) = 1. 
Then pscpiG) > p'' . 

Proposition 9. Let G be a cyclic group. Then /3sop(G) = \G\. 

Proof. Let \G\ = rp^ where (r, p) = 1 and choose two elements ft, e G of order 
r and q :— p'^, respectively, so that G = {g,h). We define a linear action of G on 
V ■■= eti Kv, by 

gvi := ^ ■ Vi and hvi := Ui+i for i = 1, . . . q 

where G K is a primitive rth root of unity and Wq+i := wi. We claim that the 
G-invariants 0{V)'^ are linearly spanned by the orbit sums Sm where r\ degm. In 
fact, 0{V)^^'^ is linearly spanned by the monomials of degree ir {i > 0), and the 
subgroup H := (h) C G permutes these monomials. 

Now look again at the element v := vi + V2 + ■ ■ ■ + Vq G V. li r \ degm then 
Sm(v) — \Hm\, and this is non-zero if and only if the monomial m is invariant 
under H. This implies that m is a power oi xiX2 ■ ■ ■ Xq. Since the degree of m is 
also a multiple of r we finally get degs,„ > rq ^ \G\. □ 

Corollary 3. Let G be a finite group. Then we have 

/3sop(G) > max(ord.g). 

Let D2n = (c, p) denote the dihedral group of order 2n with oid{a) ~ 2, ord(p) = 
n and apa^^ = p^^ . 

Proposition 10. Assume that char(ii') = p is an odd prime, and let r > 1. Then 

Note that if char(i^) = p — 2, then D2p^ is a 2-group, so Psep{D2^+^) = 2'"+^ by 
Proposition 8. We conjecture that for char(if ) = 2 and p an odd prime, we have 
/3sop(^2p) = P + 1; which would fit with Proposition 7. 

Proof. Put q = p'' and define a linear action of D2pr on V :— ®'^q Kvi by 

pvi = Wi+i and avi = — v-i for i = 0, 1, . . . , q — 1 

where Vj = Vi if j = i mod q for z,j g Z. As before, the invariants under H := 
(p) are linearly spanned by the orbit sums Sm ■= J2feHm f '^^ monomials 
m = x^qx\^ ■ ■ • x^^Zi € 0{V) = K[xo, xi, . . . , Xq^i]. Thus, the £'2^'- -invariants are 
linearly spanned by the functions {s„j -f (ts„j | m a monomial}. 

For w vq + vi + ■ ■ ■ + Vq^i we get crs„(w) s,„((ti;) = (-l)'^''8:™s^(^). 
Therefore, s„i + (ts,„ is non-zero on v if and only if Sm{v) ^ and the degree 
of m is even. As in the proof of Proposition 9, Smiv) ^ implies that m is a 
power of xoxi ■ ■ ■ Xq-i which has to be an even power since q is odd. Thus, for 
m := {xqXi ■ ■ -Xq-i)^, Sm + oSm = 2m is an invariant of smallest possible degree, 
namely 2q, which does not vanish on v. □ 
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Let Ih ■■= 0{V)1 0{V) denote the Hilbert- ideal, i.e. the ideal in 0(y) generated 
by ah homogeneous invariants of positive degree. It is conjectured by Derksen and 
Kemper that Ih is generated by invariants of positive degree < \G\, see [DK02, 
Conjecture 3.8.6 (b)]. The fohowing corohary shows that this conjectured bound 
can not be sharpened in general. 

Corollary 4. Let char X = p and G a p-group (with p > 0), or a cyclic group, or 
G = D2pr with p odd. Then there exists a G-module V such that is not generated 
by homogeneous invariants of positive degree strictly less than \G\. 

Proof. In the proofs of the Propositions 8, 9 and 10 respectively, we constructed a G- 
niodule V and a non-zero v G V such that /(f) = for all homogeneous / G 0{V)'^ 
of positive degree strictly less than \G\, but such that there exists a homogeneous 
/ G 0{V)^ of degree \G\ with f{v) ^ 0. This shows that / ^ 0(F)^^|g| OiV). □ 

Now we use relative degree bounds for separating invariants and good degree 
bounds for generating invariants of non-modular groups, that appear as a subquo- 
tient, to get improved degree bounds for separating invariants in the modular case. 

Proposition 11. Let char K = p and G be a finite group. Assume there exists a 
chain of subgroups N <Z H <Z G such that N is a normal subgroup of H and such 
that H/N is non-cyclic of order s coprime to p. Then 



Aep(G)< I 



'^\G\ in case s is even 
\G\ in case s is odd. 



Proof. By Sezer [Scz02], for a non-cyclic non- modular group U, we have P{U) < 
j\U\ in case \U\ is even, and P{U) < ||J7| in case \U\ is odd. We now assume s is 
even; the other case is essentially the same. Since l3scp{U) < (3{U) always holds, we 
get by using Theorem 2 

/3scp(G) < (5s,p{H)[G : H] < (3,,p{N)(3,,p{H/N)[G : H] 

< P{H/N)[G : H]\N\ < -^[H : N][G : H]\N\ = ^|G|. 

□ 



Example 1. Assume p = 3 and G ^ A4. The Klein four group is a non-cyclic 
non-modular subgroup of even order. We get /3sop(^4) < |l^4| = 9- Application of 
Theorem 2 shows /3sop(^4 x A^) < /3sop(^4)^ < 81. 

Example 2. Let D2n be the dihedral group of order 2n. Wc know n < Pscp{D2n) 
by Corollary 3. Assume char I\ = p ^ 2 and n = p' m with p, m coprime and m > 1. 
Then has the non-cyclic subgroup D2m of even order, so l3sep{D2n) < f 2n = 
|n. So the only dihedral groups, to which the proposition above does not apply, 
are those of the form I?2p'^, which are covered by Proposition 10. 

We end this section with two questions: 

Question 1. Which finite groups G satisfy /3scp(G) = |G| ? 

Question 2. Which finite groups G do not have a non-cyclic non-modular subquo- 
tient? 
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The dihedral groups of Proposition 10 satisfy this property, and we get /3scp(G) = 
\G\ for those groups. But in characteristic 2, /3scp(<5'3) < {S^l by Proposition 7, so 
the answer to the second question only partially helps to solve the first one. 
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